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Abstract 

Vertex- Reinforced Random Walk (VRRW), defined by Pemantle (1988a), 
is a random process in a continuously changing environment which is more 
likely to visit states it has visited before. We consider VRRW on arbi- 
trary graphs and show that on almost all of them, VRRW visits only 
finitely many vertices with a positive probability. We conjecture that on 
all graphs of bounded degree, this happens a.s., and provide a proof only 
for trees of this type. 

We distinguish between several different patterns of localization and 
explicitly describe the long-run structure of VRRW, which depends on 
whether a graph contains triangles or not. 

While the results of this paper generalize those obtained by Pemantle 
and Volkov (1998) for Z 1 , ideas of proofs are different and typically based 
on a large deviation principle rather than a martingale approach. 

Keywords: Vertex-reinforced random walk, local time, large deviation principle, 
Polya urn model, martingales 
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1 Definition of VRRW and results 



Let G be any locally finite graph without loops with the neighbor relation de- 
noted by ~. For any i£G and V <Z G, write x ~ V if there exists a site v £ V 
such that x ~ v, and write x ^ V otherwise. 

For any process Xo, X\, X2, ■ ■ ■ taking values in the vertex set of a graph G, 
we define (shifted) local times 

t 

Z(t,v) = l + J2lx s =v 

s = 

to be the number of times the site v has been visited by time t, plus one. Also, 
for any subset V C G, let the local time at this set be 

Z(t,V) = Y,Z(t,v). 

vev 

Define a vertex-reinforced random walk (VRRW) on G with starting point »£G 
to be a process {X t : t > 0} such that A^o = v and 

P^.-.^.W.^f^ (1.1) 

where Tt = <r{X\ , X2, . . . ,X t ). In other words, moves are restricted to the edges 
of G with the probability of a move to a neighbor x being proportional to the 
local time at x at that time. 

Similar processes can describe a learning behavior, or model a spatial mo- 
nopolistic competition in economics. The first problem of this kind has been 
posed by Diaconis and Coppersmith, with the weights being accumulated on 
edges rather than vertices of a graph, and has been studied later by Davis 
(1990), Pemantle (1988b), Sellke (1994) and others under various reinforcement 
conditions. 

A more comprehensive overview of the applications and known results for 
these models can be found in Pemantle and Volkov (1998). 

In this paper we show that on practically any locally-finite connected infinite 
graph without loops, VRRW gets stuck at a finite set of points (that is, only 
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finitely many vertices are visited) with a positive probability. All the results 
obtained are also valid for finite graphs. For earlier results on vertex-reinforced 
random walks on such graphs see Pemantle (1992) and Benaim (1997). One can 
also generalize the methodology we develop here for graphs with loops. 
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Figure 1: 'A core and a shell' and uniform localization. On the left: the hexagon 
is v = V\ while dark circles denote the points of V2. On the right: dark circles 
are points of S. The numbers in both pictures numbers represent limiting 
occupational measures and grey circles are points of B. 

Further, we will need the following definitions. The second can be found in 
Bolobas (1979); the first is used in this paper only. 

Definition 1 For any set of vertices S C G, the outer boundary of S is the set 

dS = {y£G\S: y~S}. 

The outer boundary is called non-embracing if there exists no point y £ dS such 
that y ~ x simultaneously for all x £ S . 

Definition 2 A subset S C G is called a complete n-partite graph if is a disjoint 
union of non-empty sets V\, V2, V n , n>2, such that 
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(a) for any i £ {1, 2, . . . , n) and any two vertices x,y £ Vi x 7^ y; 

(b) for any i,j £ {l,2,...,n}, i 7^ j each x £ Vi «s connected to every 
yeVj 

We will refer to the sets Vi as pseudo-vertices of this graph. 

Definition 3 A subgraph G' C G is called a trapping subgraph, if it consists of 
a complete n-partite graph S = V\ U V2 U . . .U V n and its outer boundary B = dS 
and the following property holds: for any y £ B there exist i £ {1, 2, . . . , n) and 
x' £ S\Vi such that y 7^ Vi U {x 1 }. 

We start with a general theorem on the localization of VRRW and consider 
some special cases and examples later. 

Theorem 1.1 Let G' = S U B, S = V\ U V2 U . . . U V n , be a trapping subgraph 
of G. Then for the VRRW which originates on G' , with a positive probability 
there exist a set of positive numbers {a v , v £ S} with ^2 veS cn v = 1 such that 
the following is fulfilled: 

(I) VRRW never leaves G' ; 

(II) Z(t, v)/t a v for all v £ S as t 00/ 

J2vev t a » = l l n f or aU i e {!> 2 ' • • •> n )' 
(w) \ogZ{t,y)/\ogt^ ^tE. g s, x~y a *f° r allyeB. 

Remark 1 Property (in) and the definition of a trapping subgraph insure that 
the RHS of (w) is strictly smaller than 1. Therefore, with a positive probability, 
the (random) limiting occupational measure of VRRW exists and has support on 
the set S . 

Now we shall investigate on which graphs trapping subgraphs exist, and 
their typical shapes. Let us begin with graphs which do not contain triangles. 
In this case n = 2, and in the simplest case is when V\ consists of a single point. 
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Corollary 1.2 (A core and a shell localization) Suppose that a vertex v G 
G ("a core") does not belong to any triangle. Let V\ = {v} ("a shell"), V2 = dV\, 
and the outer boundary B of the set V\ U V2 is non- embracing. If VRRW starts 
on G' = V1UV2UB, then with a positive probability there exists a set o/ri2 := | V2 1 
positive numbers {a x , x G V2}, ^2 xe y 2 ol x = 1/2, such that the following events 
occur: 

(1) VRRW never leaves G' ; 

(it) Z(t,v)/t — » 1/2 as t — » 00/ 

(111) Z(t, x)/t — » a x for all x G V2; 

(w) log Z{t,y) I \ogt -^2^ xeV2t x ^ y u x for all y^B. 

This theorem can by applied to any tree or lattice Z d . To extend this result 
for graphs which contain triangles, like a square lattice with two diagonals in 
alternating squares, we need the following 

Definition 4 A clique is a complete subgraph S not contained as a subset of a 
larger complete subgraph. 

(This definition is taken from Tucker (1995).) 

Remark 2 For any v G G there exist a finite clique containing v; however, it 
may be not unique. 

Now let S be a clique containing v and having n > 3 vertices (for simplicity, 
we will denote them as 1,2, . . .,n). Let B be the outer boundary of S, and 
G' = S U B. It is easy to see that B is non-embracing as soon as S is a clique, 
however, it is not enough for G' to be a trapping subgraph. 

Corollary 1.3 (Uniform localization) Let S be a clique with n := \S\ > 3 
vertices, whose outer boundary B = dS has the property that none of its vertices 
is connected to more than n — 2 sites of S . Then VRRW starting on G' = SUB 
with a positive probability satisfies the following: 
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(i) it never leaves G' ; 

(n) Z(t, x)/t — > l/n for all x £ S as t 00/ 

(111) log Z(t, y)/logt — » \{x £ S, x ~ y}\ j(n — 1) for all y £ B. 

(This corresponds to a case when every Vi consists of a single point). 

Thus, the limiting occupational measure of VRRW may exhibit different 
patterns of convergence depending on whether a graph has a complete subgraph 
of size > 3. This is not very surprising since it is known that for a closely related 
process, edge-reinforced random walk, having triangles on a graph can lead to 
substantial difficulties (see Sellke (1994)). Notice that Corollary 1.3 does not 
cover the case of a planar triangular lattice. 

1.1 More complicated types of localization 




Figure 2: General and bipartite localization. Dark circles denote points of V\, 
ovals - of V2, a square is V3 and gray circles are vertices of B. Numbers stand 
for limiting occupational measures. 

Let us show how (possibly) one can locate a trapping subgraph. 
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Iterative procedure 1. Pick any point v\ £ G, consider a clique S = {i>i} U 
{^2} U . . . U {v n } containing this point and let B = dS. If no point of B is 
connected to more than n — 2 points of S, we can immediately apply Corol- 
lary 1.3. Otherwise, there exists a vertex in B connected to all points of S 
but one (as B is non-embracing). Without loss of generality let it be v\. Set 
V\ := {y £ G : y ~ i> 8 - for all i = 2, 3, . . . , n}; hence V\ contains at least two 
points. Iteratively define Vj for j = 2,3, ... ,n by 

Vj := {y G G : j/ ~ x for all z £ (U^Vj) {J(U n k=J+1 {vk})} ■ 

Let 5 1 := U" =1 Vj. If for some j there are two vertices v' £ and d" £ Vj 
such that ~ v" , then the set 1,2, . . . , j — I, v' , v" , j + I, . . . , n constitutes a 
complete subgraph of size n + l. In this case we let S be a clique containing this 
set and start the procedure over. In the other case, when for all j no two points 
of Vj are connected, S constitutes a complete n— partite graph by construction. 
Consider B = dS. If there exists a point x £ B such that x ~ Vj for all j, we 
can find a complete subgraph having n + l vertices and we start the procedure 
again with this graph. We will stop the iterative procedure only when all Vj 
consist of non-connected vertices and for each x £ B there exists j such that 
x 7^ Vj. Note that the way we construct S leads to the existence of another 
j' zfz j such that x is not connected to some point of Vji (otherwise we would 
have x £ Vj). 



There is no guarantee that this procedure will ever stop, however, if it does, 
we call it successful. This being the case, the resulting subgraph SUB is precisely 
a trapping subgraph by Definition 3, and consequently Theorem 1.1 applies. 

Graphs for which the procedure is not successful must have some unusual 
properties (in particular, they should contain complete subgraphs of arbitrary 
high orders). 
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The corollary of this observation is that if the graph G does not contain 
triangles, it always contains a trapping subgraph, as any clique on G always 
consists of 2 vertices. In this case the complete n— partite graph in a trapping 
subgraph also has n = 2 and if both \Vi\ > 2 and | V2 1 > 2 it is natural to call 
the localization on G' := V\ U V2 U B, B = d{V\ U V2), a bipartite localization, 
in a contrast to a core and a shell localization. This localization can occur on 
Z 2 (see Figure 2 on the right). 

Remark 3 The proof of Theorem 1.1 will show that its statement remains valid 
even if VRRW starts outside of a trapping graph G' , with (1) replaced by the 
event "VRRW never leaves G' after its first visit to G' ". 

A graph G is of bounded degree if there exists a constant K such that any 
vertex of G is incident to at most K edges of the graph. Now we summarize 
the facts mentioned above. 

Corollary 1.4 Consider a locally-finite connected graph without loops. If it 
contains at least one trapping subgraph, then VRRW visits only finitely many 
vertices with a positive probability. In particular, this holds for 

(A) any graph which does not contain triangles (including Z d and trees); 

(B) any graph of bounded degree; 

( C) any graph on which the size of any complete subgraph is uniformly 
bounded by some number K . 

The next statement describes a.s. behavior of VRRW on some trees. 

Theorem 1.5 On any tree of a bounded degree, VRRW visits only finitely many 
sites with probability 1. 

The proof of this theorem and relevant open problems are presented in Section 4. 
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2 Tools 



Let be IID random variables with P{£ 8 - = 1} = 1 — P{£ 8 - = 0} = p. We start 
with an elementary fact from large deviation theory (see e.g. Shiryaev (1989) ). 



Lemma 2.1 For any < p < a < 1 

P \\ ^ a \ ^ exp{-n J ff(a,p)} 

where 



n 

! = 1 



(2.2) 



J ff(a,j 3 ) = alog- + (l-a)log^ > 0. (2.3) 

p 1 — p 

Similarly, if < a < p < 1 i/jen 

pjif><aj<exp{-nff(a,p)} (2.4) 
with the same entropy function H(a,p) given by (2.3). 

We will be interested in two special cases: when a is just barely larger (resp., 
smaller) than p and when both a and p are small. Proofs of the following two 
statements are trivial and they are omitted. 

Proposition 2.2 Let a = p + S (resp., a = p — S) and S > is small. Then 
(2.2) (resp., (24)) holds with 

F(a ' p)= M^ + K^r^) (2 - 5) 

Proposition 2.3 Let a = rp, r > 1 and a and p are small. Then (2.2) holds 
with 

H(a,p) = p(rlogr — r + 1) + @{p 2 ) > 0. 

We remark that in the proof of the main theorem we will apply these statements 
not for IID processes, but for those which are stochastically larger (or smaller) 
than them. Also, to simplify notation, we will write / = g + o(<) whenever 
f = 9 + o(g). 
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2.1 Polya urn model 

The classical Polya urn model consists in the following. An urn contains balls 
of n different colors. At each unit of time a ball is drawn at random and is then 
replaced together with another ball of the same color. Let Z(t, i) be the number 
of balls of i th color at time t, and Z(t) = J2 i Z(t, i) be the total number of balls. 
Denote the relative distribution of the colors at time t as 



Lemma 2.4 The vector a(t) converges a.s. to some random element in the 
interior of (n — l)-simplex AcR". 

In fact, even a stronger statement can be made: lim^oo a(t) has a Dirichlet 
distribution with parameters depending on the initial distribution of the colors 
(see Pemantle (1988b), Lemma 1) but we will not need it here. We present a 
very 

Short proof of Lemma 2.\. It is easy to show that, with probability one, 
lim^oo Z(t, i) = oo for all i = 1,2, ... ,n. Fix any i and observe that £ 8 (t) = 
log Z(t) — log (Z(t,i) — 1) constitutes a non-negative supermartingale with re- 
spect to the filtration Tt '■= c (Z(s, i), s <t, i = 1, 2, . . ., n) since 



as soon as Z(t, i) > 2 (using elementary properties of the logarithm). Therefore, 
Ci(t) must converge a.s. to a random value £ 8 -(oo) > 0. Let a 8 - = exp (— £ 8 (oo)) 6 
(0, 1], then 



a(t) := 



Z(t,l) Z(t,2) Z(t,n) 
~Zjf)~ , ~ZjiY , ''' , ~Z{iY 



) 




lim ct(t) = a := («i, ct2, • • • , ct n ) 



Since J2" 



1 and all a 8 are positive, a 8 < 1 for every i. 



□ 



■i = l 
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3 Proof of Theorems 1.1 



Fix small positive numbers e, 6 (0, 1) and a number (* £ (0, 1) close to one, 
and consider VRRW at the times tk when the total local time at S is exactly 
k m (the constant m > 1 will be chosen later). Formally, 

t k = mi{t > t k -i : Z(t, S) > k m ] (3.6) 

(it is conceivable that tk = oo). Let n 8 - = \Vi\, ns = 5H"=i n i be ^he number of 
vertices in S, ns = \B\ and no = \dG'\ be the number of points lying outside 
of G' but connected to G' . 

For every x £ S we define the empirical weig ht al fe) := Z(t fe , x) jk m , so that 
J2xes a ^ = 1- For * e {l;2,...,n}, let af^ = J2xev t a ^ be the empirical 
weight of the pseudo- vertex V*. Moreover, we will need "relative-to-Vi" weights. 
Namely, if x £ Vi, then its relative weight is = a x k ^ /a\ k \ Naturally, for 
any i we have l^xev, » x ' = a] . 

Let E(k) be the event that the following simultaneously happen 

Ei(k): tk < oo and VRRW does not visit points outside of G' by time tk', 

E 2 (k): > e for all x E S; 

E' 2 (k): af ] > l/(n + e*) for all i £ {l,2,...,n}; 

^ 3 (*): ^(^,J/)<fc mC forallt/e5; 

E^k): VRRW behaves "regularly" during the time period t £ 

An exact formulation of E^{k) will be given later in the proof by equations 
(3.13), (3.20), (3.22) and (3.24). Also notice that E 2 {k) and E' 2 (k) combined 
imply that is bounded below by e\ := ej{n + e„). 

We will show that P(E(k+l) \ E(k), E(k-l), . . . , E(k )) > l-j{k) where the 
the sequence f(k) is summable given a proper choice of m, (*, &o and a starting 
configuration on G' which VRRW can achieve with a positive probability. This 
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will imply that with a positive probability, all events E(k), k > ko, occur. Then 
we will prove that on the intersection of all E(kys the convergences described 
by Theorem 1.1 indeed take place. 

The proof will proceed in eight steps; on each of the steps we will assume 
that the events described in the previous steps occur (that is, we will consider 
conditional probabilities). 

In the first two steps we show that with probability at least 1 — 71 — 72, 
the time tk+i is finite and VRRW does not visit points outside of G' when 
t £ (tk,tk+i] and the number of visits to B during this time period is not too 
large. Once this is established, the way in which a trapping graph was defined 
allows us to think of VRRW as a process on a complete graph consisting of 
n vertices, with some perturbations. Then we obtain that the (conditional) 
probability of E^(k + 1) is at least 1 — 73 — 74 — 75, yielding a certain set of 
inequalities. The latter implies that the number of visits to each of the Vi while 
t £ (tk,tk+i] tends to "smooth" the differences between a^'s for different i's. 
This implies E' 2 (k + 1) and will be essential for (iii) later. Another implication 
of E 4 (k+ 1) is that 



const 



simultaneously for all x 6 S. Hence, if we start from the initial configuration 
with min^gs al^ " 1 > 2e and ko = ko(c) being large enough, E'j(k + 1) is fulfilled 
whenever f]^ =ko £2(0 occurs. Then, in Step 5, we show that E^{k + 1) occurs 
with a probability at least 1 — 76 . 

We set f(k) =71+72 + 73 + 74 + 75+76 and observe that Y,k>k 7(^) < °°- 
As a result, the probability of f] k>ko E(k) is positive. In the last three steps we 
show that (ii), (iii) and (iv) take place on this event a.s. 

Let us consider VRRW between the moments tk and tk+i assuming that 
E(k ), ...,E(k- l),E(k) all occur, and let N = (k + l) m - k m = mk" 1 - 1 + 
0(k m ~ 2 ). 
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Step 1. Let a = 2nsfc _m ( 1- ^ / e\ = o(l) and consider VRRW during the first 
aN = 2iiBmk ml '~ 1 /ei + o(<) visits to 5 after time tj.. Let t' be the time of the 
last of these visits (set it to infinity if this situation is never reached). Suppose 
that 

m(- 1 > 0. (3.8) 

Then the probability that VRRW does not leave G' during the time period 
{tk,t'\ is greater than 1 — 71, where 

i (-\ n ° X N 2n B n m 

11 = l -\}-7^) = ^d-c) + ^- ^ 

Step 2. We state that the event {t' > t^+i} has probability close to 1. To 
show this, notice that the total number of visits to S during the time period 
(tj,, min(t', tfc+i)] does not exceed N, therefore 

P ({t' < tk+i}) < P(the number of visits to B exceeds aN 
while S has been visited N times) 

However, each such visit has a probability smaller than 

V-= JL 7 ^— = -^°^) (3-10) 
under the assumption that 

mC, > m — 1. (3-11) 

Consider a Bernoulli sequence i = 1,2,... TV where the probability of a 
success is p. The number of successes in this sequence is stochastically larger 
than the number of visits from S to B between times tj, and t^+i = tj, + N . 
Therefore, by Proposition 2.3 with r = 2 and p and a being indeed small, 

P(t' < t k+1 ) < expi-dk^- 1 + («)) =: 72 (3.12) 

where C\ = ri£m(21og2 — l)/fi Pri 0.386nsm/ei. Consequently, t^+i is finite 
with probability larger than 1 — 72 and by that time, 

the number of visits to B does not exceed TVb := Ck ml '~ 1 , (3.13) 
C = 2nsm/ei, 
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and 72 is small since (3.8) is fulfilled. 

Step 3. Assume now that the events mentioned in the two previous steps 
occurred, namely t^+i < oo, VRRW does not leave G' and the number of visits 
to B is at most N B = o(N) while t £ (tj, , tk+i] ■ Consequently, VRRW on G' can 
be "almost" coupled with a VRRW on a complete graph of n vertices. Indeed, 
during the N — o(N) steps after visiting Vi, the set Vj, j ^ i, is visited with 
probability proportional to a total local time at Vj. This justifies the name 
"pseudo- vertex" used to address V^'s. 

Let Ni denote the number of visits to Vi during the time period (tk,tk+i\- 
Observe that Ni < (N +N B )/2. Hence, the number of visits to S\Vi lies between 
(N - N B )/2 = N/2 - o(<) > N/4 and N. Every time VRRW is at 5\V;-, it can 
go either to G'\Vi or to Vi. The probability of the latter event is at least 

V = t = ei — o(l). 

k m + N + n B k m ( + N B ' 

Now we want to apply Proposition 2.2. Choose S £ (0, fi/2) so small, that the 
expression in the RHS of (2.5) is a strictly positive and independent of k (one 
can do this because p(l—p) > t\ (1 — ei) — o(l)) and set a := p — S. After making 
a comparison with the IID sequence of Bernoulli variables as done in Step 2, we 
conclude that the probability that during the first N/4 departures from S\Vi 
the set Vi is visited less than N/4 x (ei — S)/2(> eiN/16) times is smaller than 

/ N \ 

7* = exp I —const x — + o(<) J • (3-14) 

Taking into account that the probability of the intersection of n (not necessarily 
independent) events, each having probability at least 1 — 7* cannot be less than 
1 — 717* , we see that this value is a lower bound for the probability of the event 

{ei#/16 < Ni < N for all i). (3.15) 

From now on we will condition on (3.15). Let rriij denote the number of visits 
from Vi to Vj, m 8 - = X^j^i m v be the total number of departures from Vi to 
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S\Vi and m\ = ^j^rnji be that of arrivals. Clearly, |m 8 - — m'-| < #5 and 
\mi-Ni \ < N B . 

Our goal is to estimate mij/rrii for a fixed j. Every time a particle departs 
from Vi and does not go to B, it goes to Vj with probability of order 

a™ 

P = + O^- 1 ) = -^y + O^- 1 ). 

El*,- «; 1 " «} 

Apply Proposition 2.2 with a = p + k~^ where 

(o,mm{^^,m(l-C),l}) (3.16) 

so that S = k~P + o(<). We obtain that with probability greater than 1 — 7** 
where 

/ k~ 2/3 \ 

7" = exp y- 2p{1 _ p) m ij + °(<0 < exp (-meiA m - 1 - 2 "/8) + o(<) (3.17) 

(we used the lower bound for Ni = m 8 - + O(Nb) and the fact that 2p(l — p) is 
at most 1/2) the following holds: 

(k) 

Repeating the same arguments for a := p — k~^ implies the probability that 

>-^-k~" (3-19) 



'1 

is also at least 1 — 7**. Consequently, we have 
..(*) 

< k' 13 for all i,j e {1,2, . . .,n} such that j ^ i (3.20) 



I -a? 

with probability exceeding 1 — 72 — 73 — 74 where 

74 = 2n(n - 1)7" + n 7 * = 2n(n - 1) exp (-meifc m - 1_2/3 /8) + o(<) (3.21) 

which decays to zero since 2/3 < m — 1. 

Step 4. We start with the following useful statement, the proof of which is 
given in Subsection 3.2. 
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Lemma 3.1 Assume that (3.20) takes place and § < [3 < m(l — (*). T/jen i/jere 
exists a (possibly negative) constant C" depending only on n, n B , e, e\ and m 
only such that for any j £ {1, 2, . . . , n) and large k 

^> 3 [ 3 ' +C'k-P. (3.22) 
N ~ 1 - 1/n K ! 

Notice that on any segment, the function f(a) = a(l — a) / (1 — 1/n) achieves 

its minimum at one of the endpoints. So, together with 

3 Z -). 3 - n + e* ' 

Lemma 3.1 yields 

Ni>N/(n + e t ) (3.23) 

once k is large enough. This, in turn, implies E' 2 (k + 1). Note that since 
N B /N = o(k- fi ), we also obtain that m' { > N/(n + e*) + o(<). 

Fix i £ {1,2,. ..,n} and a; G Vi, and consider all the moments when VRRW 
goes from S\Vi to V*. Taking into account that l/a^ < n + e* and a!' 1 '' < 1, 
we obtain that at these times the probability p to go to x is bounded from below 

by 

( f km > <#) - ^+-^ + o(k-i) 
a f) k ™ +N ~ k 

and from above by 

Now we can carry through the same arguments that we used in the previous 
step: we apply Proposition 2.2 with S = k~@ + ( n +^*) m = _|_ (<|) twice (j3 is 
the same as before and in both cases p£ (e, 1 — e)). Consequently, the number 
N x of visits to vertex x satisfies 

m'i x (4 fe) -6) < N x < m'i x (a^ + 6) + N B (3.24) 
< m'i x (4 fe) + <^+ (n + e*)N B /N) 
= m'i x (aj^ + J + o^)) 
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7*** = exp 



with probability at least 1 — 27*** where 
/ k~ 2/3 \ 

[- 2p{1 _ p - ) m 'iJ + °H < ex P (-2mfc m - 1 - 2 ' 3 /(n + e,)) + o(<). 

(3.25) 

Therefore, with probability 1 — 75, 

7 5 := 27*"xns, (3.26) 

the inequalities in (3.24) hold simultaneously for all x 6 S (with i being a 
function of x - the index of the pseudo- vertex to which x belongs) . 
Let us show that this implies (3.7). Indeed, for x 6 Vi, 

- (fc + i) = ui k) k m + N x gWgfh m + Njja^ + S) + N B 
af ] k m + Ni ~ af ] k m + N { 

= & W + ^' S + NB < + m(n + e,)*" 1 -" + o^" 1 "") 
af'k m + Ni 

since m — 1 — [3 > mC, — 1. Similarly, 



^) a f ) k m + {Ni _ NB){ ^) -8) 



af ] k m + Ni 



> -m^ + e*)*- 1 -" + o{k- 1 - fi ). 

Consequently, the bounds given by (3.7) take place. 

Step 5. Now we want to obtain that not only the number of visits to B is 
smaller than Nb but, in fact, with a probability close to one, for any y £ B the 
number of visits N y to the vertex y does not exceed (r')~ 1 m(k ml '~ 1 for some 
constant r' > 1. This will automatically imply Es(k + 1) once Es(k) holds. 

Depending on the graph, there are at most two ways the vertex y can be 
visited by VRRW: it can be visited either from S or from B (the latter cannot 
take place on graphs without triangles). Regardless, we will show that the 
number of visits of the second type is of order o(k m ^~ 1 ) and therefore negligible. 

The probability p to jump to y from B is at most k" 11 ^ / (cik m ) + o(<). Setting 
r = 2 and a = rp in Proposition 2.3 yields that the probability of the event 
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"VRRW comes to y from B more than aNs = o(k m ^ 1 ) times" is smaller than 
7* = exp (-pN B (log 4 - 1)) + o(<). 

Suppose that 

<f) := 2m( - m - 1 > 0. (3.27) 

Then pNs is proportional to k^ and 7* = 7* (k) goes to zero as fast as exp(— ck^), 
for some constant c > 0, whence ^2 k J*(k) < 00. 

Let us concentrate now on the visits from S to y. The probability p to go 
to y is bounded above by 

n=±k m y ' n-l y ' 

n + e„ 

Recall the definition of a trapping subgraph. One of the conditions on it required 
that there be at most n — l different pseudo- vertices V^'s connected to y (at least 
by one edge) and there is some x' belonging to one of them such that x' 7^ y. 
Therefore, according to (3.23), the time spent on those vertices of S from which 
VRRW is allowed to go directly to y is at most 

N ~' = N { 1 -dz)- N "- 

Let Vi be the pseudo-vertex to which x' belongs. By (3.23) and (3.24) 
N x < _ N x , w Ni ^ ,_ (fc) n 1 ^ e/2 



>(a^-S)—> 



N N{ N ~ y x ' n + e* ~ n + e* 
and consequently, 

<n _l + e> _ e/2jy 



Next, 



If 



pN„ y = {J (l - £ ^ r f ) } mC*"*^ 1 + o(<). 



< e/2 (3.28) 
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and 

l- £ ^f<C<l, (3.29) 
n — 1 

then the expression in the curly brackets is smaller than one. As a result, we 
can pick some r' > 1 such that r'{l — (e/2 — — 1)}/C < 1- We apply 

Proposition 2.3 and obtain that with probability 1 — 7**, 

7** = exp (-C^"^" 1 + o(<)) (3.30) 

where C'2 = C'i{j-' , e, e*, m, n) > 0, the number of visits to y from S does not 
exceed r'pN^ y . By the same arguments, this (the statement that the number 
of visits to y is smaller than (r')~ 1 m(k ml '~ 1 ) holds simultaneously for all y £ B 
with probability at least 1 — 76 , where 

76 = (7* + l**)nB (3.31) 

is small as soon as (3.8) is fulfilled. Therefore, Es(k + 1) occurs with probability 
close to one. 

Before proceeding to the next step, it is natural to ask whether the constants 
m, C, e, e*, /? and r' can simultaneously satisfy conditions (3.8), (3.11), (3.16), 
(3.28), (3.27) and (3.29). The answer is positive. Indeed, for any positive e 
smaller than l/n, we can take = e/4, m = 2, r' = 1 + e/(4n — 4), (* = 
1 — 32 (n-i) 2 anc ^ @ = 32(n-i) 2 • ^ ^ s eas y to check that all the conditions are 
fulfilled with this set of parameters. 

Step 6. In this and the following steps we condition on the event 

Loc= P| E(k). 

k>k 

As we know by now, P(Loc) > n&(l — 7(^)) > since ^2~f(k) < 00. The event 
Loc automatically implies part (i) of the Theorem 1.1. 
From (3.22) we obtain that 

«r" = >/(«n +<»*<- »)*-■-' w 
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where f{a) = a[l + m(l — na)/((n — 1)&)]. Since X^"=i = 1> the sequence 
of random variables defined by 

(k) 

rih '■= 1 — n mm a) 
ie{i, 2, ..,«!> 

is non-negative. The observation that the function f(a) is increasing for all 
a G (0, 1) when > 3m and inequality (3.32) yield the following formula: 

m+i <m +c"k- 1 -o (3.33) 

with the constant C" being independent of k and 

Proposition 3.2 Let a non-negative sequence {r)k}1?-i satisfy condition (3.33) 
with < [3 < m. Then rjk — > as k ^ oo. 

Proof of the proposition. The case C" < is straightforward, so we will assume 
that C" > 0. Let fik = Vk — hk~? where the constant h > will be chosen later. 
Then (3.33) yields 

/ ra\ (m - B)h - C" ,, -, „. / m\ 
< (l " j) Hk ~ K ~ ^ + oik- 1 -?) < (l - -) Vk 

as soon as h > C" / (m — /?) and k is large. If all are positive, then the 
equation above implies that lim^oo = 0. On the other hand, if \i\ < for 
some / then it follows that fif. < for all k > I. In any case, since hk~? — » 
and rjk > 0, we have 

lim inf % > and 

k— )-oo 

lim sup % = limsup( / Ufe + hk~?) = lim sup < 

k— )-oo /e— )-oo 

and the proposition is proven. □ 

Therefore, on hoc we have lim^oo a^" 1 = 1/n for every i G {1,2, . . .,«}• 
On the other hand, (3.7) implies convergence of ai^ = ai k ^ /a\ k ^ for all x G V{. 
Combining this with Z(tj, , B) = o(Z(tk , S)) and (tk+i — tk)/tk ~ * as k — > oo, 
we obtain parts (ii) and (iii) of the Theorem. 
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Step 7. The only statement left unproven thus far is part (iv). 

For its proof, pick a very small v > 0. From Step 6 and equations (3.22) 
and (3.24) it follows that on Loc there exists some k\ > ko such that for any 
k > ki 



Z(t k+ i,x) - Z(t k ,x) 



< — for every x £ S 



(3.34) 



and for any t > fc™ 



Z(t, x) 
Z{t, Vi) 1 



> v for every 



< v for every i £ {1,2, 



Z(t,S) n 

Z(t, y) < 2(Z(t, S)) c for every y £ B 



} and 



(3.35) 



Consider a new sequence of times {sj} where 

Sj = mf{t > Sj _i : Z(t, S) > (1 + v) j ), 

Since {sj} grows much faster than the sequence {t k }, one can obtain from (3.34) 
that 



Z(s j+ i,x) - Z(sj,x) 



< 



2v 

n s 



(3.36) 



(1 + - (1 + v )i 
for all x £ S and all j greater than some j\ > mlog 1+ ^ k\. 

Fix some y £ B and let N^ y = N^ y ( j) be the number of visits to the points 
x £ S from which VRRW can go to y between the moments Sj and Sj+i- Also 
let Ny be the number of visits to y from S, N y ' be the number of visits to y 
from B, and N y = N y (j) = N' + N' 1 be the total number of visits to y during 



this time interval. Inequality (3.36) yields 

{a^ y - 2v)N < N^ y < {a^ y + 2v)N 



(3.37) 



where N = N( j) = i>(l + i>y is the total number of visits to S during this period 
(maybe, plus or minus one) and 
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The probability that VRRW will jump to y from some x £ Vi such that x ~ y 
when t £ (sj, Sj+i] is 

> z (sj,y) 



Z(t,S\Vi) + J2Z(t,y>) ~ (l-± + v)Z( Sj+1 ,S) + 2n B (Z( Sj+1 ,S)Y 

(3.38) 

> Hi) = = n 

- (1- l/n + 2v){l + v)i+ 1 ' P P(J> 
as soon as Z(.Sj, S) is large enough (the sum on the LHS ranges over all y' £ B 
such that y' ~ x). Here we used (3.35) and set L(j) := Z(.Sj, y) for simplicity. 
Consider an IID sequence of Bernoulli zero-one random variables £i, ^2, 
£n„ with P(^j = 1) = p. Then Ny is stochastically larger than S := 
£1 + . . . + £n„ (and N y > Ny). Consequently, from Chebyshev's inequality we 
obtain that 

1 

v 2 pN^ 

where the event A(j) is 



P(A(jy)<-—- (3-39) 



Mi) ■= {N y -pN„ v >-vpN„ v }. 
Also observe that (3.37) implies 

/ ft \ 7/ 

[—[ a ~y ~ 8 ») TT^ L{j) ~ pN ~ y ~ C2L{j) (3 ' 40) 

by using the following obvious inequalities: 

n 1 n 

1 < < 2, > 1 - x, -a^ y < 1 

n — 1 1 + x n — 1 

where C2 is a constant not depending on j. 

Let us show that L( j) — > co as j — > co. If the contrary were true, there would 

exist some j'2 and L such that L(j) = L as soon as j > j'2. The probability of 

the event B(j) = {VRRW does not jump to y at all when t £ (,Sj, Sj+i]} is at 

most (1 — p) N ~y and, because of (3.40), it satisfies 

lim sup P(B(j)) < limsupexp(— pN^ y ) < C3 < 1 
j — >■ 00 j — >■ 00 
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for some constant C3 = 6*3(71, a^ y , v, L). Consequently, P ((^j>j 2 B(j)) = 
and we obtain a contradiction with the assumption that L(j) is bounded. In 
particular, together with (3.40) this implies that the RHS of (3.39) goes to zero 
and the events A(j) occur infinitely often. 

Let us introduce two recursively defined integer- valued sequences of stopping 
times: 

j'k = inf {i > fk-i : A ti - 1 ) occurs} 
j'k = inf {i > J'k ■ A ti occurs} 

where k = 0,1,2,... with the exception of j' which is the smallest j > j\ for 
which (3.38) holds. So, 

ii < j'o < j'o < j'i < j'i < j'2 < j" < ■ ■ ■ 

Notice, that j' k is finite as soon as is finite (since the A(j)'s occur infinitely 
often). We cannot make a similar statement about j'^; in fact, we will show 
that a.s. there exists a number k such that t'^ = 00. To prove this, observe that 
(3.40) yields 

L(j + 1) > L(j) x (l + (1 - !/) (^rj a ~y ~ 8^) YT^) = X R ^ 

whenever the A(j) takes place. Suppose that v is so small that R = R{v) > 1. 
Then, by the construction of the sequences {j' k } and {j'f!}, there exists a constant 
C* 4 > such that L(j' k ) > C 4 R k for all k > 0. Let C(k) = {t' k ' < 00} be the 
event that t' k is finite. Then, according to (3.39), 

/ 00 \ 00 _ 

p (CW ) = PU# + ')'<E toft = 7kJ^ 

\l = J 1 = ^ * 

whence ^2 k P(C(k)) < cxd. We remark that, in fact, we should be considering 
P(A(j) c I Loc) rather than the probability mentioned in (3.39) which conditions 
only on part of Loc up to a certain moment of time. However, since for any two 
events A and B we have P(A C | B) < P(A C )/P(B) and the probability of any 
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subset of Loc is uniformly bounded from zero by P(Loc) > 0, the sum above 
must be corrected by a multiplicative constant smaller than P(_Loc) _1 , so it will 
remain bounded. Therefore, P(C(k) occurs infinitely often) = and for some k 
we have t'£ = oo. On this event, L(j) > C^-R*" 1 "- 7 ' - - 7 '* and hence 

Kmmf l^M) > llmmf lo^a- l) > log^H (3 . 41) 
t->oo logt ~~ j->-oo log(l + vy ~ log(l + i>) 

Since v > can be chosen arbitrarily small, we let — )- and obtain 

Y ■ Jog Z(t,y) log R(i/) n 

lim mi > lim - — — = ra~w • 

t->oo logt ~ v-to log(l + v) n — 1 

Step 8. To complete the proof, it suffices to show that for any a* such that 

Tl 

-a^ y < a* < C (3.42) 

n—1 

and any sufficiently small v > such that a*(l + v) < (*, we have 

logZft,t/) 

limsup - <a*(l + v). (3.43) 

t ^oo logt ~ 

We will use similar arguments as in Step 7, however here we also have to estimate 
the number of visits to y from B. According to (3.35), the probability to go to 
y at time t > Sj is at most 

Z(t,y) = Z(t,y) 
Pt ' (1-^-^(1 + ^ $ 

($ = $(j) = (1 — 1/n — v)(l + v) J ) whenever X t -\ G S 1 and no larger than 

v(l + vy 

when X t -\ G 5- Besides, the total number of visits to B between times Sj and 
Sj+i does not exceed 2(1 + v)^ +1 ^ . As soon as v is small, C5 is a constant 
larger than one and we notice that if, instead of being at B, X t -\ were at S 
consecutively 2C5 times, the probability of visiting y would be larger. Therefore, 
Z(.Sj + i, y) is stochastically smaller than a random variable ip(Nj, where 

:= (a„ y + 3v)N > N^ y + 2C 5 x 2(1 + v)^ +1 ^ = N^ y + o(N„ y ) 
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and ip(t) is a Markov process defined by 

pty(t + i) = k + i\i>(t) = k) = i-P(ij(t + i) = k\ip(t) = k) = A j 

^(0) := Z( 8j ,y)=L(j). 

Let Ti = inf{t : ip(t) = ip(0) + i} and A 8 = T 8 -_|_i — i = 0, 1, 2, . . .. It is easy 
to see that the A 8 's constitute a sequence of independent random variables and 
for each i, A 8 has a geometric distribution with parameter 

L(j) + i 

so that P(A 8 = k)= pi{l - Pif' 1 , k=l,2,.... 

Let W = va*L(j). The event B(j) := {ip(N*) > L(j) + W} equals the event 
{^(W) < where 

w-i 

8 = 

Hence, by Chebyshev's inequality, 

P(B(j)) = P(^(W) < N*) < P(\^(W) - E^(W)\ > E^(W) - N*) 

Var(^(Py)) 
- (Etf(W) -#0 2 ' ' 



Notice that 



iv-i , w-i , 



£^ Pi + » " Jl 



— dx 



8 = 

$1ok ( 1 + -^y ) > $fi/a* -i/ 2 ^ 



m x 



and 



W-l 1 _ W-l f L(j) + W-l 1 

Var(*(^)) = £^£<£i<W ^ 

i = ^ 8 = Pi J L(j)-l X 

2 P£ 2 va*® 2 

(L(j)-l)(L(j) + W)-l) ~ L(jf ~ L(j) 
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for large j. Furthermore, 

ft ft 

EV(W)-N* > (1 - l/n)i/(l + i/V[Q!* - v -va t -(a^ y + 3is)} 

n — 1 n — 1 

1 71 

> T^{\ + v) 3 [a* - —[ a ~y ~ 9^)] = C 6 (i/)(1 + v) 3 

where C'e = Cq(v) is a constant which is positive as soon as 9i> < a* — ^a^j. 
Consequently, (3.44) implies 

P(5(i)) < -gy- (3.45) 

However, from Step 7 we know that there exists a > 1 such that _L(j + l) > aL(j) 
and therefore • P(5(j)) < oo. Thus, the Borel-Cantelli lemma yields that 
the 5(j)'s occur only finitely many times, so that L(j + 1) > L(j) + W > 
+ va *) f° r large j. Hence, 

v \o&Z{t,y) log L(j) log(l + ^) 

limsup - — < limsup- — — — — < - — — — — < a*(l + v) 

t^oo logt j^oo log(l + i^)J log(l+i/) 

as soon as v < 1. Once again, notice that in (3.45) we ignored conditioning on 
a "future" part of Loc, however, we were alowed to do so since a*(l + v) < C 
implies B(j) c C Loc and therefore P{B(j) \ Loc) = 1 - P{B(j) c \ Loc) = 1 - 
P(B(j) c )/P(Loc) < (1 - P(B(j) c ))/P(Loc) = P(B)/P(Loc). Consequently, 
(3.45) should be corrected by a multiplicative constant which is at most P(_Loc)) _1 < 
oo. Therefore, (3.43) is established and the proof is completed. □ 

Remark 4 The proof of Theorem 1.2 shows that by choosing a proper initial 
configuration, the limiting distribution of {a x } can be arbitrary close to any 
element of the interior of the \S\ — n- dimensional set A ni x A„ 2 x . . . x A„ B 
where A„ t is a n 8 - — l-simplex. Therefore, the set of all possible limiting weights 
is dense on this set. 



25 



3.1 A core and a shell localization of VRRW with an ir- 
regular vertex 

Here we will derive an implication of the proof of Theorem 1 . 1 that is essential for 
the proof of Theorem 1.5. Consider "a core and a shell" configuration described 
in Corollary 1.2. Suppose that there exist an extra point v* lying outside of 
the graph G and connected to a point v ("the core") only. Recall that Z(t,x) 
is a local time at vertex x 6 G. At the same time, let Z(t, v*) be an arbitrary 
sequence with Z(t, v*) > A for alH > (thus, v* is an "irregular" vertex). Let 
VRRW* be a reinforced random walk on G U {v*} obeying the law (1.1) with 
X(0) = v. 

Denote by <p(A, {Z(t, v*)}) the probability never to leave G* := G'U{v*} for 
a particular sequence {Z(t,v*)}%Z and let <p{A) = inf ip( A, {Z(t, v*)}) where 
the infimum is taken over all sequences such that Z(t,v*) > A. Then the 
following statement holds. 

Lemma 3.3 For VRRW* described above, 

lim <p(A) = 1. (3.46) 

A — )-cx) 

Proof. First, we will explain how Corollary 1.2 (the localization of a regular 
VRRW) can be proven directly using the ideas from the proof of Theorem 1.1 
but not as its corollary. Second, we will modify the arguments to accommodate 
for the presence of the irregular point. 

Recall that the numbers of vertices in B and dG' are ns and no respectively 
and consider a regular VRRW on G starting at v. Fix some < e < 1/(2^2) 
and take the "snapshots" of VRRW at the moments tj, when the joint number 
of visits to V'i is [& m J, k > ko where m > 1 is some constant. Redefine E(k) to 
be the intersection of the events 

Ei(k): VRRW does not visit points outside of G' ; 

E2(k, e): > e for all vertices x 6 V2; 
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E 3 (k): Z{t k ,y)<k m < for ally £5; 

E^{k) m . VRRW behaves "regularly" during the time period t G (t k -i,t k ]- 

Using the same arguments as in the proof of Theorem 1.1, one can show that 

P (E(k) | E(k - l),E(k - 2), ... , E(k )) > 1 - j(k) 

with ^2 k>ko l(k) < 00 when the initial configuration is "proper" in the sense 
that all a^x°^ > 2e and ko = ko(e) is so large that 

E const (e, n'j) 
¥+p < e ' 

k>k 

Since lim/^oo ^2 k> i f(k) = 0, the probability that VRRW never leaves G' is not 
only positive, but can be made arbitrary close to one by choosing a large enough 
k on the event E^ko) f]E 2 (k , 2e) {~\E 3 (k ). 

Next, recall that we are actually interested in VRRW on G with v* . Hence, 
one can carry through the arguments presented above, though with a couple of 
corrections. First, we are not guaranteed that t k < oo for all k, due to the fact 
that VRRW may get stuck jumping between v and v* (if Z(t, v*) grows with 
t faster than linear, for example). However, this is also a localization. Second 
(iii) and (iv) in Corollary 1.2 do not necessarily hold anymore, but, as the proof 
of Theorem 1.1 shows, for a localization this is not important. As a result, we 
obtain that for any S > there exists ki(e,S/b) such that 

P(f| E(k)\E k0 )>l- S - (3.47) 

k>k 

as soon as ko > ki(e,S/b). 

The last step consists in proving that either a "proper" starting configuration 
is achieved by VRRW* with a probability converging to one as A grows or 
VRRW* gets stuck at v and v* . To achieve this goal, we pick an arbitrarily 
small S > and show that <f>(A) > 1 — S whenever A > Ao for some Ao = Ao(S). 

Consider a Polya urn model with balls of different colors. By Lemma 2.4, 
the relative distribution of colors a(t) converges a.s. to some random vector 
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a = («i, «2, • • • , «n 2 ) i n the interior of (ri2 — l)-simplex. Consequently, there 
exists e = e(6) > so small that 

P(mina; > 2e) > 1 - -. (3.48) 

i 5 

Since a(t) — > a a.s., a(t) also converges to a in distribution and therefore there 
exist some to = to(c, <V5) such that for any t >to 



P(minai > 2e) - P (mm ai(t) > 2e) 



< f • (3-49) 



Next, notice that the probability that VRRW does not visit x 6 V2 even once 
while visiting i> for the first A 2 ! 3 times is at least 

( 1 -t)"'" = 1 -3^ + ^- , "»- ( " C| 

Hence VRRW makes a large number of steps to v from v* and back before it 
hits V2 for the first time. Similarly, VRRW does not visit B during its first A 1 ! 3 
visits to V2 with probability exceeding 

(l-^) J "* = '-il7i + ^- 1/3 ) (»•»!) 

At the same time, when VRRW visits V2 from i>, conditional on not going to 
B, the distribution of Z(t, x), x £ V2, coincides with that of a Polya urn model 
with balls of colors. 

Let e = e(6) be as given in equation (3.48), to = to(c, <^/5) is taken from (3.49) 
and ki = ki(e,S/b) from (3.47). Set 

a ix\ ( f 5n 2 5n B ' x 3 

Ao(d) = I max < — ,— — ,to,ki 

and consider VRRW* with A > Aq. On the event that it does not get stuck at 
{v}U{v*}, formulae (3.48), (3.49), (3.50) and (3.51) imply that with probability 
1—4(5/5 there will be a moment of time t when the set V2 has been visited exactly 
A 1 ! 3 times, B has not been visited at all and Z(t, x)/A 1 / 3 > 2e for all i £ V2. 
Combined with (3.47), this yields that <p(A) > 1 — S. Since S > was arbitrary, 
(3.46) follows. □ 
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3.2 VRRW on a complete graph 

Proof of Lemma 3.1. 




Figure 3: Illustration of VRRW on a complete graph with n = 3 

In this Subsection we omit the superscript ^ on the alphas to make notation 
less cumbersome. We will also write x Prf y whenever x = y + 0(k~P N) in the 
sense that \x — y\ < Ck~@ N for large k with a constant C > not depending 
on k or the state of VRRW. 

Recall that rriij (i ^ j) denotes the number of steps from Vi to Vj between 
the moments tj, and t^+i- Set ma = 0. As before, m 8 - = ^ - rriij is the number 
of times VRRW leaves the pseudo- vertex Vi for S, and Ni is the total number 
of visits to Vi from both S and B. Since the number of times VRRW comes to 
Vi should match the number of times VRRW leaves it, we have 

rtii = rriij & rtiji for all i G {1,2, ... ,n}; 

j j 

N ^2 i m ij + m ji) (3.52) 

i, 3 
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where we take into account the fact that Nb = 0(8 N) where S = k 13 + o(<) 
and that there is a possibility to go from Vi to Vj through B without changing 
rriij . 

Observe that (3.20) can be rewritten as 

O ' 

rriij Pi - — - — -m 8 - for all i and j ^ i. (3.53) 

First, we want to show that (3.52) and (3.53) imply 

rriij & rriji for all i and j, (3.54) 

that is, the number of crossings of any edge in one direction is close to the 
number of crossings of this edge in the opposite direction. Without loss of 
generality, it suffices to prove that m\'i & "rri'ii- Indeed, 

1 - «i ^ 
mi2 Pi mi Ri m 2 i + > mn; 

A i>2 
1 - 2 sr~^ 

m 2 i Pi m 2 Pi mi2 + > m 8 ' 2 

tti 

1 i>2 

whence 

m 12 Pi rn-zi + ^2 {a-zmi ~ oim i2 ) ■ 

On the other hand, (3.53) implies that each of the terms in the sum is Pi 0, so 
that m\'i Pi m,2\ ■ 

Next, (3.53) combined with (3.54) yields that for all i and j, 



o 8 -(l - o 8 ) a^l-oy) 
Finally, observe that Nj > rrij and N Pi E 8 m 8 which yield 

n- n~ E ; =1 m8 ~ e: =1 - «o 1 - e: =1 a?) - 1 - 1/« 

where we use the fact that E a i = 1 and, therefore, ^]a- < 1/n. □ 
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4 The problem of universality 



A natural question arises after seeing Theorem 1.1, Corollary 1.2 and Corol- 
lary 1.3: since VRRW gets stuck with a positive probability, does this imply 
that it must get stuck somewhere with probability one? Unfortunately, we can- 
not answer this question in all cases (in particular, for Z d , d > 2). This is, in 
part, due to the non-Markovian nature of the process and the impossibility of 
using Kolmogorov's zero-one law directly. 

Moreover, in general, this is not true. Indeed, consider a tree that on level 
n has K n branches coming out of each vertex with ^K^ 1 < oo. VRRW on 
this tree can make infinitely many steps without ever coming back to any vertex 
it has previously visited, with a positive probability. Therefore the probability 
that VRRW visits only finitely many vertices is smaller than one, though it is 
positive by Corollary 1.2. Consequently, the "traditional" a. s. -recurrence vs. 
a. s. -transience dichotomy does not hold here. 

However, we conjecture that on a very broad class of graphs of bounded 
degree, VRRW visits a.s. only finitely many points. We also believe that on 
any periodic graph the number of different kinds of subgraphs on which VRRW 
can get stuck is finite and is given by the set of all possible trapping subgraphs, 
or perhaps, a slightly broader class of subgraphs (for example, Theorem 1.1 
implies that there are at least two different patterns of localization on Z 2 ). The 
latter is a generalization of the conjecture in Pemantle and Volkov (1998) that on 
Z 1 VRRW will eventually get stuck at the set of exactly 5 points. Unfortunately, 
at this time we do not have a proof for any of the above statements. 

For trees of bounded degree (including Z 1 ) the fact that VRRW localizes 
(eventually gets stuck at a finite set) follows from the following arguments. 

Proof of Theorem 1.5. Embed the tree G in the plane such that the root (the 
vertex where VRRW starts) is at the top, the vertices adjacent to the root are 
placed one level below, etc. We say that VRRW moves up or down depending 
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whether it gets closer or farther from the root respectively. A vertex v c is called 
a child of a vertex v (and v is called the parent of v c ) if v c is adjacent to v and 
v lies on the path connecting v c to the root. 

Since VRRW is on a tree, a possible localization is "a core and a shell" as 
described by Corollary 1.2. Moreover, each vertex is incident to no more than 
K edges, whence the number of different trapping subgraphs G' with outer 
boundaries dG' is finite. This observation will play an important role later in 
the proof. 

Denote by A(v) the local time at the parent of v when VRRW visits vertex 
v for the first time and set A(v) = oo if VRRW never hits v. Consider the sum 



Two cases are possible: Sa < oo and Sa = oo. We state that in the second case 
VRRW gets stuck at some "core and shell" configuration almost sure, which, in 
turn, yields a contradiction since l/A(v) ^ only for finitely many v. Indeed, 
Sa = oo implies that there exist infinitely many times when VRRW makes 4 
consecutive steps down through the vertices it has never visited before. Let v' 
be the lowest of these four vertices; therefore the local times at each of three its 
direct ancestors equal 2. Consider a trapping subgraph 



with v' being "a core" . It is easy to see that there are only finitely many non- 
isomorphic combinations (G'UdG' , {Z(t, x), x £ G' U dG'}) since the local time 
on any vertex of G'UdG' is at most 2. Consequently, there exists some constant 
7 > depending on K only, such that the probability that VRRW gets stuck 
on G' is at least 7. 

Let N be the number of times when VRRW makes four consecutive steps 
down on vertices not visited before. Then the probability not to end up with 
a core and a shell localization is at most (1 — 7)^. On the other hand, Sa = 




G' = {v'}[jd{v'}[jd(d{v'}) 
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oo insures that there are infinitely many such times and therefore the above 
probability must be zero. 

To show a localization in the other case (Sa < oo), we construct a subcriti- 
cal branching process on the vertices of G. Suppose that VRRW visit infinitely 
many vertices. Then there exists an infinite sequence v\, i>2, . . . of distinct ver- 
tices of G to which VRRW goes, ordered by the times of the first visits to them. 
The finiteness of Sa yields 

lim A(vi) = oo. (4.55) 

i— )-oo 

Consider VRRW* described in Section 3.1 on all possible trapping sub- 
graphs of G with the property that their "cores" (points v) are connected to no 
more than K — 1 vertices. There are only finitely many such subgraphs, hence 
Lemma 3.3 implies the existence of a number Ao such that the probability ever 
to leave any such subgraph does not exceed v = 1/K 2 as soon as the local time 
at the "irregular" vertex v* is at least A > Ao = Ao(v). 

According to (4.55), there exist io such that A(vi) > Ao for i > io- Let to 
be the time of the first visit to i> Jo . We construct a branching process on the 
vertices of G as follows. The process starts at time to and initially consists of 
the subset of vertices visited by time to lying on the boundary of the set, 

|i>i : i < io and there exists x £ G\ ^Ufcii^'}) such that x ~ i> 8 - j- . 

There may be up to to such vertices. 

We say that a vertex v "dies" if VRRW never visits any of its great-grandchildren 
(points connected to v by 3 consecutive edges all going down). In the other 
case, at the very moment when some great-grandchild v ggc of v is visited for 
the first time, we say that v splits into a set of vertices consisting of all de- 
scendants of v (on the graph) which are adjacent to at least one point of G 
not visited by VRRW by this time. The cardinality of this set cannot exceed 
(A' - l) 2 - 1 + (A' - 2) + (A - 1) = A 2 - 2. 
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Consequently, each point v of the vertex-branching process constructed above 
either splits into at most K 2 — 2 new particles or dies with probability at least 
1 — v regardless of the history of VRRW. The latter follows from the observa- 
tion that once v is visited for the first time with v p being its parent, we can 
couple the VRRW on the subtree of G consisting of v and all its descendents 
with a VRRW* for which an "irregular" vertex is v* = v p . Since A(v) > Ao, by 
Lemma 3.3 the probability to visit any great-grandchild of v does not exceed v. 

Therefore, the vertex-branching process is stochastically smaller than a Galton- 
Watson process in which each particle either branches into exactly K 2 — 2 par- 
ticles with probability v or dies with the complimentary probability, indepen- 
dently of the others. As the expected number of direct descendants of a single 
particle for this process is x (1 — v) + (K 2 —2)xv < 1, the Galton- Watson pro- 
cess is subcritical and therefore dies out (e.g., see Athreya and Ney (1972)). This 
implies that the vertex-branching process also dies out and this is equivalent to 
a localization of VRRW. □ 
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